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IMAGE PROCESSING METHOD AND APPARATUS 



BACKGRaUND OF THE INVENTION 

The present invention relates to a method for 
quasi halftone processing of image that is used in 
printers, scanners, copy-machines and facsimile, and in 
5 which lower-gradation image data is reproduced by the 
modulation of a high or multi-gradation image into an 
image having a smaller number of gradations. 

There is a systematic dither approach 
(hereinafter, referred to as dither) as one of the 

10 methods for quasi half-tone processing of multi- 
gradation images. We shall describe a binarizer for 
converting a multi-gradation image to a binary image by 
this conventional dither. 

Fig. 7 is a diagram showing the construction 

15 of the conventional binarizer using the dither, and 
Fig. 8 shows the conventional dither matrix. 

The binarizer will be briefly described with 
reference to Fig. 7. Referring to the figure, image 
data 1 is original multi-valued data to be binarized. 

20 These data to be binarized for use in printers are 
usually image data having four color components of 
black, cyan, magenta and yellow. Dither matrix storage 
unit 3 has a dither matrix stored therein as a table of 
threshold values shown in Fig. 8. This table is an 

25 example of the dither matrix that is used when the 

thickness of image data 1 has a range of 256 gradations 



from level 0 to level 255. This matrix data has so far 
been designed so that dots can be regularly arranged on 
the basis of a certain generation rule. There is also 
shown a comparator 2, which receives thickness data N 
5 of each pixel of each color component of the image data 
1, and threshold data T corresponding to the 
coordinates of this image data from the dither matrix 
storage means 3. The comparator 2 then compares the 
image data N and the threshold data T to produce a 

10 binarization result Q of 1, or a binary signal of dot 
ON when N>T, and the binarization result Q of 0, or a 
binary signal of dot OFF when N<T. These processing 
operations are performed for all the pixel data of each 
of the color components that constitute the image data, 

15 thus finally generating binary image data. 

SUMMARY OF THE INVENTION 

It is generally known that the binary image 
generated by the conventional dither method is 
deteriorated in its gradation property and picture 

20 quality because a quasi contour or texture occurs in a 
certain thickness region, particularly in the low- 
thickness region. In addition, in the edge region is 
reduced the edge sharpness called jagy peculiar to the 
dither method, so that the edge reproducibility is 

25 remarkably lowered. The problems with the low 

thickness region in the prior art is ascribed to the 
dot pattern generated by the dither method. In other 



words, the periodic dot arrangement produced in the 
binarized image by the dither method causes the above 
problems. Moreover, since the dither method determines 
dot output by only the comparison with threshold, large 
5 error occurs in the binarized image relative to the 
original image, and hence it is difficult to reproduce 
the image with a satisfactory picture quality. Another 
method can be used to produce non-periodic dot output, 
and a method such as error diffusion method can be 

10 considered which can suppress the error between the 

original image and the binarized image to the minimum. 
However, although an effect of the edge reproducibility 
and quasi contour improvement can be confirmed in the 
low thickness region, the dot output is isolated, and 

15 hence dot saturation in the intermediate and high 

thickness region occurs depending on a printer used. 
In addition, the graininess deteriorates and good 
gradation property cannot be obtained. Accordingly, it 
is an object of the invention to solve these problems. 

2 0 According to the present invention, in order 

to solve the above problems,, dots are non-periodically 
produced in the low thickness region, and periodically 
produced in the intermediate and high thickness region. 
In addition, error diffusion processing is made in all 

25 thickness regions, and dots are produced one by one in 
the low thickness region in which the non-periodic dot 
arrangement is taken, and produced in a dot- 
concentrated manner in the intermediate and high 



thickness region in which the periodic dot arrangement 
is taken. Moreover, non-periodic dot output is used in 
the image edge region. Therefore, the quasi contour 
and gradation property in the low thickness region can 
be improved. Also, in the intermediate and high 
thickness region, use of the dot-concentrated 
arrangement reduces the dot saturation, leading to the 
improvement in the gradation property and graininess. 
Moreover, by taking the non-periodic dot arrangement in 
the edge region, it is possible to improve the 
reproducibility of the edges. 

According to the invention (claim 1), there 
is provided an image processing method for making image 
gradation modulation to receive a multi-tone image and 
generate image data of a low gradation number by quasi 
halftone processing, characterized in that the dot 
arrangement of image after the gradation modulation is 
a mixture of a periodic dot output region and a non- 
periodic dot output region. Therefore, by use of the 
periodic dot output or non-periodic dot output in 
accordance with the feature of the image, it is 
possible to achieve the reproduction of a high-quality 
image with the above problems solved. 

According to the invention (claim 2), there 
is provided the method characterized in that the 
periodic dot output region is an intermediate and high 
thickness region of the image. Therefore, by taking 
the periodic dot arrangement in the intermediate and 



high thickness region in which the dot density 
increases, it is possible to prevent the gradation 
property from being reduced by the saturation of dots, 
and the graininess from being deteriorated. 

According to the invention (claim 3), there 
is provided the method characterized in that the non- 
periodic dot output region is a low thickness region of 
image. Therefore, the periodic texture occurrence in 
the low thickness region can be suppressed, and the 
quasi contour can be improved. 

According to of the invention (claim 4), 
there is provided the method characterized in that the 
non-periodic dot output region is an edge portion of 
image. Therefore, a dot arrangement can be taken to 
follow the edge portion, and thus the edge 
reproducibility can be improved. 

According to the invention (claim 5) , there 
is provided the method characterized in that error 
diffusion method or mean error minimization method is 
applied to the periodic dot output thickness region, 
and a threshold matrix for periodic dot output is used 
as threshold values. Therefore, by applying periodic 
data to threshold values, it is possible to take a 
periodic arrangement of dot output after the error 
diffusion processing or mean error minimization method. 

According to the invention (claim 6), there 
is provided the method characterized in that error 
diffusion method or mean error minimization method is 



applied to the non-periodic dot output thickness 
region, and a threshold matrix for non-periodic dot 
output is used as threshold values. Therefore, by 
applying non-periodic data to threshold values, it is 
possible to take a non-periodic arrangement of dot 
output after the error diffusion processing or mean 
error minimization method. 

According to the invention (claim 7), there 
is provided the method characterized in that error 
weighting coefficients that are used for propagation of 
error in the error diffusion method or the mean error 
minimization method applied to the periodic dot output 
thickness region are different from those used for 
propagation of error in the error diffusion method or 
the mean error minimization method applied to the non- 
periodic dot output thickness region. Therefore, it is 
possible to take the dot shape and dot arrangement that 
are suitable for the periodic arrangement and non- 
periodic arrangement. 

According to the invention (claim 8), there 
is provided the method characterized in that the dots 
generated in the periodic dot output thickness region 
are of a dot concentrated type. Therefore, by 
concentrating dots in the region in which the dot 
density increases, it is possible that even a printer 
easy to cause dot saturation stably produces dots, and 
thus that the graininess and the gradation 
reproducibility are improved. 



According to the invention (claim 9) , there 
is provided the method characterized in that the dots 
generated in the non-periodic dot output thickness 
region are isolated. Therefore, it is possible to 
prevent the graininess in the low thickness region from 
being deteriorated. 

According to the invention (claim 10), there 
is provided the method characterized in that the error 
weighting coefficients used for propagation of error in 
the error diffusion method or mean error minimization 
method applied to the periodic dot output thickness 
region do not take the maximum for a pixel nearest to 
the pixel of interest. Therefore, concentrated dots 
can be formed. 

According to the invention (claim 11), there 
is provided an image processing apparatus for making 
image gradation modulation to receive a multi-tone 
image, and generate image data of a low gradation 
number by quasi halftone processing, the image 
processing apparatus being characterized by having a 
unit for producing after the gradation modulation an 
image of which the dot arrangement has a mixture of a 
periodic dot output region and a non-periodic dot 
output region. Therefore, by using the periodic dot 
output or non-periodic dot output in accordance with 
the feature of the image, it is possible to reproduce a 
high-quality image with the above problems solved. 

According to the invention (claim 12), there 
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is provided the apparatus characterized by further 
having a unit for deciding if the dot arrangement of 
the image after the gradation modulation includes the 
periodic dot output region or the non-periodic dot 
5 output region. Therefore, it is possible to select the 
periodic dot output or non-periodic dot output in 
accordance with the feature of the image. 

According to the invention (claim 13), there 
is provided the apparatus characterized by further 

10 having a unit for storing a threshold matrix for the 
periodic dot output, a unit for storing a threshold 
matrix for the non-periodic dot output, and a unit for 
selecting either one of the threshold matrix for the 
periodic dot output and the threshold matrix for the 

15 non-periodic dot output in accordance with the decision 
result from the decision unit according to claim 12. 
Therefore, by switching the threshold matrices, it is 
possible to selectively take the non-periodic dot 
output and the periodic dot output. 

20 According to the invention (claim 14), there 

is provided the apparatus characterized by further 
having a unit for making propagation of error by error 
diffusion method or mean error minimization method, a 
unit for storing error weighting coefficients for the 

25 periodic dot output, a unit for storing error weighting 
coefficients for the non-periodic dot output, and a 
unit for selecting either one of the error weighting 
coefficients for the periodic dot output and the error 
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weighting coefficients for the non-periodic dot output 
in accordance with the decision result from the 
decision unit according to claim 12. Therefore, by 
generating a high-reproducibility image by error 
5 propagation and selecting the error weighting 

coefficients to more accurately produce the isolated 
dots and concentrated dots, it is possible to stably 
reproduce dots and generate high-quality printing data. 

According to the invention (claim 15), there 

10 is provided the apparatus characterized by further 
having a unit for detecting an edge portion in the 
received multi-tone image. Therefore, by detecting the 
edges, it is possible to take the non-periodic dot 
arrangement following the edge portion, and thus 

15 improve the edge reproducibility. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows an image processing apparatus 
using an image processing method according to one 
embodiment of the invention. 
20 Figs. 2A and 2B show examples of the error 

diffusion coefficients used in the error diffusion 
processing according to the embodiment of the 
invention . 

Fig. 3 shows one example of the threshold 
25 data used as the threshold values of the periodic dot 
output according to the embodiment of the invention . 

Fig. 4 shows one example of the threshold 
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data used as the threshold values of the non-periodic 
dot output according to the embodiment of the 
invention. 

Fig. 5 is a flowchart showing the flow of the 
5 processing according to the embodiment of the 
invention. 

Fig. 6 shows the dot arrangement after the 
binarization according to the embodiment of the 
invention. 

10 Fig. 7 shows the conventional binarizing 

apparatus . 

Fig. 8 shows the conventional dither matrix. 

DESCRIPTION OF THE EMBODIMENTS 

An embodiment of the invention will be 

15 described about the conversion of multi-tone image to 

binary data. Fig. 1 shows the construction of an image 
processing apparatus using an image processing method 
according to one embodiment of the invention. 

Referring to Fig. 1, there is shown an image 

20 storage unit 101 for storing multi-valued image data to 
be processed. The pixel data of the image data within 
the image storage unit 101 is supplied pixel by pixel 
to an image data acquiring unit 102. The pixel data 
acquiring unit 102 acquires data of pixel units from 

25 the image data stored within the image storage unit 
101, and supplies it to a thickness region decision 
unit 103 and to an edge detection unit 104. The 



thickness region decision unit 103 decides whether the 
pixel data acquired by the pixel data acquiring unit 
102 is a low thickness region or an intermediate and 
high thickness region, and supplies the decision result 
5 to a dot arrangement decision unit 105. The edge 

detection unit 104 decides whether the pixel acquired 
by the pixel data acquiring unit 102 is an edge 
portion, and supplies it to the dot arrangement 
decision unit 105. The dot arrangement decision unit 

10 105 decides whether the dot arrangement is periodically 
or non-periodically taken according to the thickness 
decision result from the thickness region decision unit 
103' and to the edge decision result from the edge 
detection unit 104, and supplies the decision results 

15 to a diffusion coefficient selecting unit 111 and to a 
threshold matrix selecting unit 108. The diffusion 
coefficient selecting unit 111 selects a diffusion 
coefficient stored in either one of a periodic dot 
output coefficient storage unit 109 and a non-periodic 

20 dot output diffusion coefficient storage unit 110 on 
the basis of the dot arrangement decision result from 
the dot arrangement decision unit 105, and supplies it 
to an error diffusion computing unit 112. The 
threshold matrix selecting unit 108 selects threshold 

25 data stored in either one of a periodic dot output 
threshold storage unit 106 and a non-periodic dot 
output threshold storage unit 107 according to the dot 
arrangement decision result from the dot arrangement 



decision unit 105, and supplies it to the error 
diffusion computing unit 112. The error diffusion 
computing unit 112 makes error diffusion processing on 
the basis of the error diffusion coefficient produced 
5 from the diffusion coefficient selecting unit 111, the 
threshold produced from the threshold matrix selecting 
unit 108, and the error data stored in an error storage 
unit 113. The error diffusion computing unit 112 
supplies the binary result after the processing to an 

10 image output unit 115, and to an error calculation unit 
114. The error calculation unit 114 makes calculation 
of error caused upon binarization on the basis of the 
binary result from the error diffusion computing unit 
112 and the pixel data produced from the pixel data 

15 acquiring unit 102, and supplies the error data to the 
error storage unit 113. The error storage unit 113 
stores the error data fed from the error calculation 
unit 114, and supplies it to the error diffusion 
computing unit 112. 

20 The embodiment of the invention about the 

above construction will be described in detail. 

First, data of pixel units is obtained by the 
pixel data aquiring unit 102 from the image data stored 
in the image storage unit 101, and supplied to the 

25 thickness region decision unit 103, error calculation 
unit 114 and edge detection unit 104. The thickness 
region decision unit 103 decides whether this pixel is 
low thickness region or intermediate and high thickness 



region according to the pixel data produced from the 
pixel data acquiring unit 102. In other words, when 
the pixel data is represented by D, and when the 
thickness levels of the multi-tone image data stored in 
5 the image storage unit 101 have a width from 0 to 255, 
the thickness region decision unit 103 decides that, 
upon satisfying the condition of D<L where L is the 
boundary thickness level, L (0<L<255) of the low 
thickness region, the pixel data is in the low 

10 thickness region, and upon satisfying the condition of 
D>L, the pixel data is in the intermediate and high 
thickness region. The edge detection unit 104 decides 
whether this pixel is edge region on the basis of the 
pixel data produced from the pixel data acquiring unit 

15 102. The edge portion can be decided according to the 
pixel data including the pixel of interest, and a pixel 
or pixels adjacent to that pixel. Here, the way that 
this edge portion is decided will not be described. 
The result of deciding whether this pixel is edge 

20 portion is supplied to the dot arrangement decision 
unit 105 as is the thickness region information from 
the thickness region decision unit 103. The dot 
arrangement decision unit 105 receives the thickness 
region deciding result and the edge decision result, 

25 and decides whether periodic or non-periodic dot 
arrangement should be taken on the basis of these 
information. When the edge decision result is edge 
portion, non-periodic dot arrangement is decided 



irrespective of the thickness region. When it is not 
edge portion, but in low thickness region, the unit 105 
decides the non-periodic dot arrangement. When it is 
not edge portion, but in the intermediate and high 
5 thickness region, the unit 105 decides the periodic dot 
arrangement. The dot arrangement decision result from 
the dot arrangement decision unit 105 is supplied to 
the diffusion coefficient selecting unit 111 and to the 
threshold matrix selecting unit 108. The diffusion 

10 coefficient selecting unit 111 that received the dot 

arrangement decision result selects the error diffusion 
coefficient from the periodic dot output diffusion 
coefficient storage unit 109 when the dot arrangement 
decision result is periodic dot arrangement or selects 

15 the error diffusion coefficient from the non-periodic 
dot output diffusion coefficient storage unit 110 when 
the dot arrangement decision result is non-periodic dot 
arrangement. Then, it supplies the error diffusion 
coefficient to the error diffusion computing unit 112. 

20 Figs. 2A and 2B show examples of error diffusion 

coefficients for use in the error diffusion processing 
according to the embodiment of the invention. Fig. 2A 
shows an example of diffusion coefficients stored in 
the periodic dot output diffusion coefficient storage 

25 unit 109, and Fig. 2B shows an example of diffusion 
coefficients stored in the non-periodic dot output 
diffusion coefficient storage unit 110. In addition. 
Figs. 2A and 2B show a pixel of interest 150 to be 
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binarized, and two pixels 151 most adjacent to the 
pixel of interest 150. The periodic dot output 
diffusion coefficients shown in Fig. 2A have two 
diffusion coefficients of "0" nearest to the pixel of 
5 interest 150. Although the two pixels 151 nearest to 
the pixel of interest 150 are usually most weighted, 
those pixels are here dared to set as above in order 
that dots can be arranged in a concentrated manner. 
That is, since the dot output results at the two pixels 

10 151 nearest to the pixel of interest 150 are not 

referred to, the result is that dots are arranged in a 
concentrated manner. On the contrary, the non-periodic 
dot output diffusion coefficients shown in Fig. 2B, 
stored in the storage unit 110, take a coefficient 

15 arrangement substantially similar to that of the 
generally used error diffusion coefficients. 

The threshold matrix selecting unit 108 that 
received the dot arrangement decision result from the 
dot arrangement decision unit 105, when the dot 

20 arrangement decision result is periodic dot arrange- 
ment, acquires a threshold corresponding to the 
currently processed pixel from the periodic dot output 
threshold storage unit 106, and supplies it to the 
error diffusion computing unit 112. Fig. 3 shows an 

25 example of the threshold data used as the periodic dot 
output threshold values according to the embodiment of 
the invention. In the figure, the pixels indicated by 
the bold italics correspond to the center dots where 



dots are centered. These centered dots are 
periodically arranged as illustrated. Around the 
center dots are arranged threshold values so that dots 
can be concentrated at the center dots. Thus, the 
5 concentrated dots that grow from the center dots are 
produced by periodic arrangement of center dots. 

When the dot arrangement decision result is 
non-periodic dot arrangement, the threshold matrix 
selecting unit 108 acquires a threshold corresponding 

10 to the currently processed pixel from the non-periodic 
dot output threshold storage unit 107, and supplies it 
to the error diffusion computing unit 112. Fig. 4 
shows an example of the threshold data used as the non- 
periodic dot output threshold values according to the 

15 embodiment of the invention. In the figure, the pixels 
indicated by the bold italics correspond to the center 
dots where dots are concentrated. These center dots 
are non-periodically arranged as illustrated. Around 
the center dots are arranged threshold values so that 

20 dots can be non-periodically arranged. Thus, non- 
periodically arranged dots are produced. 

Then, the error diffusion computing unit 112 
determines the amounts of error diffusion according to 
the input diffusion coefficients, and makes binarizing 

25 processing on the basis of the input threshold. The 
binarized result is supplied to the image output unit 
115, and to the error calculation unit 114. The error 
calculation unit 114 calculates binarization error at 



the current pixel on the basis of the binarized result 
from the error diffusion computing unit 112 and the 
pixel data produced from the pixel data acquiring unit 
102, and supplies it to the error storage unit 113. 
5 The error storage unit 113 stores the error data fed 
from the error calculation unit 114, and supplies it as 
error for the next pixel to the error diffusion 
computing unit 112. The above processing operations 
are performed for all pixels of the input image. 

10 The embodiment of the invention will be 

further described with reference to Fig. 5 that is a 
flowchart showing the process flow according to the 
embodiment of the invention. 

First, pixel data as a pixel of interest to 

15 be processed is acquired (step S200) . Then, decision 
is made if the thickness of that pixel is in the low 
thickness region or the intermediate and high region 
(step S210) . In addition, decision is made if that 
pixel is an edge portion (step S220) . Then, decision 

20 is made if dots are periodically or non-periodically 
arranged (step S230) . Here, the decision condition is 
that if the pixel of interest is in the intermediate 
and high thickness region or not the edge portion, dots 
are periodically arranged, and if the pixel of interest 

25 is in the low thickness region or the edge portion, 

dots are non-periodically produced. If, at step S230, 
the decision result is periodic dot arrangement, 
threshold values are set in order that dots can be 



periodically arranged {step S240) . In addition, error 
diffusion coefficients are set in order that dots can 
be periodically arranged (step S250) . If, at step 
S230, the decision result is non-periodic dot 
5 arrangement, threshold values are set in order that 
dots can be non-periodically arranged (step S260) . 
Additionally, error diffusion coefficients are set in 
order that dots can be non-periodically arranged (step 
S270) . Then, weighting error at the pixel of interest 

10 is calculated by use of the set error diffusion 
coefficients, and added to data of the pixel of 
interest acquired at step S200, thereby producing the 
pixel data of interest, D after error weighting (step 
S280) . Moreover, this pixel data D after error 

15 weighting is compared with the set threshold value Th 

(step S290) . If D>Th, dot is produced (step S300) . If 
D<Th, no dot is produced. Then, error occurring upon 
binarization is calculated (step S310) , and the 
calculated error is stored and maintained (step S320) . 

20 The above processing operations are made for all pixels 
of the input image (step S330) , and the binarization 
processing ends. 

While a method of generating binary images in 
this embodiment has been described, the binary error 

25 diffusion method given in the description of this 

embodiment can be applied even to a multi-valued output 
of ternary or above value by expanding it to a multi- 
valued error diffusion method. 
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Thus, according to the present invention, the 
error diffusion processing can be performed for all 
thickness regions, non-periodic dot arrangement can be 
taken for the low thickness region and edge portion, 
5 and periodic dot arrangement can be taken for the 

intermediate and high thickness region. In addition, 
dot-concentrated type dots can be formed, and periodic 
texture in the low thickness region can be removed. 
Additionally, since dots in the edge portion can be 

10 arranged to non-periodically follow the edge portion, 
the edge reproducibility can be improved. Moreover, 
since concentrated dots are periodically formed in the 
intermediate and high thickness region, even a printer 
of which the print dots are unstable can be improved in 

15 the dot saturation and graininess deterioration. Also, 
since the error occurring upon binarization can be 
minimized by the error diffusion processing, the image 
reproducibility after binarization can be greatly 
increased. Therefore, high-quality picture printing is 

20 possible because the factors that have great effect on 
the printed picture quality, such as the graininess in 
the low thickness region, edge reproducibility, and 
gradation reproducibility by stable dot output in the 
intermediate and high thickness region, can be 

25 improved. Fig. 6 shows the dot arrangement after 
binarization according to the embodiment of the 
invention. From Fig. 6, it will be understood that 
small dots are non-periodically arranged in the low 



- 20 - 

thickness region, and that concentrated dots are 
periodically arranged in the intermediate and high 
thickness region. 



